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PRINTING MEDIA AND METHODS EMPLOYING DIGITAL WATERMARKS 

Related Application Data 
This application is a continuation-in-part of copending application 09/567,405, 
5 filed May 8, 2000. 

Other related applications are cited below in connection with particular teachings 
for which they are relevant. 

Field of the Invention 
10 The present invention relates to use of digital watermark technology in 

conjunction with envelopes and other documents. 

Background and Summary of the Invention 
Computer printers have long been used to print addresses on envelopes. With the 
15 advent of digital postage, use of printers with envelopes is increasing still further. 

Digital postage technology is available from a number of vendors including 
Pitney Bowes, E-Stamp, Stamps.com and Escher Laboratories (of Escher Group, Ltd.), 
and is detailed in various patent publications including 5,982,506, 5,825,893, 5,819,240, 
5,801,364, 5,774,886, 5,682,318, 5,978,781, and WO 99/18543AL 
20 Digital watermarking technology is used, in accordance with certain embodiments 

of the present invention, to increase the security of, and augment the functionality 
associated with, computer printing of envelopes and postage. 

In accordance with one aspect of the invention, traceability of digital postage is 
enhanced by serialization, i.e., embedding a serial number code or other indicia that 
25 uniquely and covertly links the printed postage to some device or software in the users' 
possession, or that identifies the user. This device can be a printer, personal computer, or 
hardware security device used in printing the postage. In an exemplary embodiment, 
digital watermarking of the sort detailed in the cited patents and applications is used to 
embed the code at the time the postage is printed. The embedded data would only be 
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detectable to investigators equipped with special readers for spot checking documents or 
investigating counterfeits. 

In accordance with another aspect of the invention, security of digital postage 
against reproduction is enhanced through use of "fragile" digital watermarks. (A 
5 "fragile" digital watermark is one designed, e.g., not to fully withstand the 

scanning/printing operations associated with photocopying or PC-based scanning and 
printing.) Such a watermark may be employed to provide forensic evidence that printed 
postage is not original. 

In accordance with yet another aspect of the invention, watermark technology is 

1 0 employed to prevent - outright - the photocopying or other duplication of digital postage. 
This result is achieved by encoding on envelopes a "do not copy" watermark to which 
photocopiers, scanners, printers, and other computer devices are alert. If such a 
watermark is encountered, the device will refuse to operate, or will otherwise interfere 
with the reproduction operation. 

15 In accordance with still another aspect of the invention, watermarking on an 

envelope is employed as an element of a franking mark (postal mark) - one that may stay 
within or extend well beyond the corner location typically associated with such marks. 

In accordance with yet another aspect of the invention, watermarking on an 
envelope can serve as a portal to a corresponding internet site or internet-based 

20 application. That is, a printed document with an embedded watermark can be held up to 
a web cam, or scanned by a scanner, and instantly link a user to Internet sites or 
applications. Importantly, information received in this manner is not subject to the delays 
associated with physical mail delivery, but can convey up-to-the-minute information. 
In accordance with still another aspect of the invention, an envelope watermark 

25 serves to convey an identifier that is used to access associated data in a database. In one 
particular application, the index number identifies the recipient. Thus, for example, an 
envelope can be addressed simply by watermarking it with a unique recipient designator, 
e.g., JOHNQPUBLIC843. Processing equipment in the postal system can read the 
watermark, query a database with the designator, and determine thereby the recipient's 

30 physical address. (If desired, the address thereby discerned can be printed on the 
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envelope.) One advantage to this arrangement is that distribution of Change of Address 
cards would be a thing of the past. If a person moves across country, a single record in 
the database is changed. All mail to that recipient automatically is directed to the new 
physical address. 

5 In accordance with yet another embodiment, digital watermarks on envelopes can 

be applied by specialized printers (e.g., postal metering devices), or by using common 
office printers (e.g., laser, ink-jet). In such systems, the watermark embedder software 
may be integrated into the printing device, or can be resident on an associated computer 
system. The software is desirably secured against tampering using various anti-hacking 
10 techniques. The production of the digital watermark may not be optional (i.e., it may be 
applied without user control), and the payload can be tailored in accordance with the 
^ amount of postage, device/software/user information, or other application information. 

Sn Such a system may also include an application that calibrates printing of the watermark to 

J the user's specific printer or software, thus accommodating a wide range of usage 

vi 15 scenarios. A hardware security device used, e.g., to store postage value (e.g., a digital 
CI vault) may also be employed by the watermark embedding system, e.g., as a source of 

L secure and potentially unique data used in encoding the digital watermark. 

H In accordance with still further embodiments of the invention, the principles 

described herein are also applicable to other printed value documents (e.g., tickets and 
5f 20 coupons), especially those that are printed on demand. Such documents may be printed 
at home, at special kiosks (e.g., in-store), or by commercial printing establishments (i.e., 
mass produced). Among other functionality, the watermarks in such value documents 
can be used by investigators to distinguish originals from reproductions (by use of fragile 
watermarks), to authenticate documents (e.g., in ticket reading machines), and to link to 
25 associated internet resources. The watermarks can also be linked to other information 
(e.g., event date, seat number, product code, etc.) textually printed on the document, or 
present on the document in some machine readable form (e.g., barcodes). In such case, 
the watermark can be used to detect document alteration by checking for discrepancy 
between the watermark-encoded information, and that otherwise conveyed by the 
30 document. 
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In accordance with yet other embodiments of the invention, blank printing stock 
(e.g., other than envelopes) can be digitally watermarked to serve various ends. The 
watermarking continues to be detectable after the blank stock is thereafter printed. 

The features just-described can be employed alone or in various combinations. 
5 The foregoing and additional features and advantages of the present invention will 

be more readily apparent from the following detailed description. 

Detailed Description 
Digital watermarking technology, a form of steganography, encompasses a great 
10 variety of techniques by which plural bits of digital data are hidden in some other object 
without leaving human-apparent evidence of alteration or data representation. 

Digital watermarking of envelopes can be effected in numerous ways, including 
by ink (clear, optically-opaque, IR/UV-opaque), by texturing, by laminate layers, etc. 
The watermarking can be formed as part of other markings on the envelope (e.g., 
15 franking marks, graphics, text, etc.), or can be applied irrespective of such other 

markings. Watermarking can be effected at any time in an envelope's life, including at 
the time of media-making (e.g., paper making or Tyvek formation), at the time of 
envelope making, at the time of consumer use (either before, during, or after the 
application of other envelope markings), and thereafter (e.g., in the course of postal 
20 service processing). 

The watermarking may span all of one side (or both sides) of an envelope, or may 
be localized, e.g., in the areas typically associated with postage, return address, and 
recipient address. An envelope may convey a single watermark, or several may be used, 
e.g., conveying different information or serving different purposes in different regions. 
25 Several different watermarking technologies can be employed on a single envelope, e.g., 
the envelope's texture can convey one type of information, and tinting printed on the 
envelope can convey a second type of information. 

Any print- or physical media-watermark technology can be employed in 
conjunction with the present invention. Representative watermarking technologies 
30 suitable for such use are detailed in the assignee's patent 5,862,260, and in applications 
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09/074,034, 09/127,502, 09/503,881, 09/562,516, and 09/562,524. A great many other 
watermarking technologies are familiar to those skilled in the digital watermarking art. 

In accordance with one aspect of the invention, traceability of digital postage is 
enhanced by serialization, i.e., embedding a serial number code or other indicia that 
5 uniquely and covertly links the printed postage to some device in the users' possession. 
In one such embodiment, the watermark serves to convey an identifier of a 
printer, personal computer, postage vault, or other device used in printing postage. The 
identifier can be a registration number, a serial number, an account number, etc. The 
watermark can also serve to convey an identifier associated with particular software 
10 employed by the user. And/or, the watermark can also serve to identify the user. Other 
forensic information can likewise be encoded. 

The encoded information can directly correspond to the device, etc., or the 
relationship can be established through a remote database (e.g., the identifier can be an 
index number that, when looked-up in a database, yields the registered owner name and 
1 5 address of a particular device) . 

Typically, such a watermark is "private," i.e., it is readable only to selected 
classes of persons who have access to secret data, such as a private key. Postal 
investigators and the like would be able to read such data (e.g., by using a specialized 
reader system, or by using a conventional reader system equipped with the private 
20 information), but the general public would not. 

In other embodiments, the watermark is public, but general use thereof is limited 
because a database needed to interpret the encoded data is not publicly accessible. 

As indicated above, this forensic watermark can take various forms. For example, 
it can form part of the franking indicia printed on the envelope, or can be separate from 
25 such indicia. It can be limited to the franking corner of the envelope, or can be located in 
a different location, or span a larger area. One particular implementation deposits a light 
splattering of tiny ink droplets over an area. These droplets are sufficient to form a 
computer-detectable pattern, but are not conspicuous (or preferably even visible) to 
human observers. In this, and other embodiments, the invisibility of the markings can be 



i 



WYC:lmp io/n/00 60307 -6- EXPRESS MAIL NO. EL69 64 5418 8US 

enhanced by using inks responsive to ultraviolet or infrared illumination, as more 
particularly detailed in cited application 09/562,516. 

In most applications, the forensic watermark is applied automatically as part of 
another envelope processing activity. Thus, for example, such functionality can be 
5 provided in software used to print addresses on envelopes, or apply digital postage to 
envelopes. The software can be of the consumer variety (e.g., Microsoft Word), or it can 
be system or device instructions invoked as part of the printing operation (e.g., printer 
driver software, or firmware associated with a printer's microprocessor.) As the user- 
intended information is being printed, the forensic marking is also being applied. 
10 Thereafter, if an issue arises as to the source of an envelope, or postal indicia thereon, the 
forensic information can be checked to aid in such investigation. 
^ In accordance with a second aspect of the invention, security of digital postage 

P against reproduction is enhanced through use of "fragile" digital watermarks. 

J As noted, a "fragile" digital watermark is one designed not to fully withstand the 

3f 15 scanning/printing operations associated with photocopying. (The use of fragile 
I watermarks is detailed in the assignee's applications 09/234,780, 09/287,940, 09/433,104 

* u and 09/498,223, §91625,511, 60/198,138, 09/645,779, and in three applications filed 

D herewith: Halftone Watermarking and Related Applications <docket 60302>; 

y~ Watermarks Carrying Content Dependent Signal Metrics for Detecting and 

20 Characterizing Signal Alteration <docket 60305>; and Watermarking Recursive Hashes 
Into Frequency Domain Regions <docket 60306>.) If markings (e.g., legitimate franking 
indicia) incorporating such a watermark are photocopied or otherwise reproduced from 
one envelope onto a second envelope, the copy will either not fully include the 
watermark, or the watermark will be changed in a way that indicates it is a copy. 
25 Processing equipment in the postal system can be alert to such copies (which are 

identified by the absence or modification of the fragile watermark), and cull them from 
the properly-franked mail. Likewise, fraud or counterfeit investigators can use special 
readers to verify originality and detect copies. 

A watermark may be made fragile in numerous ways. One form of fragility relies 
30 on low watermark amplitude. That is, the strength of the watermark is only marginally 
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above the minimum needed for detection. If any significant fraction of the signal is lost, 
as typically occurs in photocopying operations, the watermark becomes unreadable. 

Another form of fragility relies on the watermark's frequency spectrum. High 
frequencies are typically attenuated in the various sampling operations associated with 
5 digital scanning and printing. Even a high amplitude watermark signal can be 

significantly impaired, and rendered unreadable, by such photocopying operations. 

The foregoing are but two of many different approaches. The above-cited 
applications disclose many others. The particular fragile watermark used can be tailored 
in accordance with the type of scanning and printing anticipated in unauthorized 

10 reproduction. 

Likewise, the fragile watermark can be implemented in various ways. For 
example, the watermark can be implemented by varying thicknesses of lines, adding dots 
or speckles or ink, or modulating the brightness of printed pixels. (Such watermarking 
arrangements are further detailed in applications 09/074,034 and 09/127,502.) Or the 

1 5 watermark can be formed by texturing of the substrate. Such texturing can be applied in 
various ways. One is by a mechanism integrated with the printer, e.g., one that impresses 
the medium with a pinch roller or other pressure-applying means. Another is during 
fabrication of the paper, e.g., by texturing dewatering elements in the paper making 
machinery to impress a desired pattern on the medium. (One such arrangement is 

20 detailed in application 09/437,357, filed November 1 0, 1 999.) 

As indicated, processing equipment in the postal system (e.g., document sorters 
and postal processing machines) can routinely scan envelopes bearing digital postage for 
the presence of the expected fragile watermark. Any envelopes found to be missing the 
watermark can be culled for investigation. This analysis may include watermark-reading 

25 software that infers information about the type of reproduction employed by reference to 
the attributes of any remaining fragile watermark signal. 

In accordance with a third aspect of the invention, watermark technology is 
employed to prevent - outright - the photocopying or other duplication of digital postage. 
This result is achieved by encoding on envelopes a "do not copy" watermark to which 

30 photocopiers, scanners, printers, imaging software, or other computer devices are alert. If 
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such a watermark is encountered, the device will refuse to operate, or will otherwise 
interfere with the reproduction operation. 

Such watermark-based "do not copy" systems are further detailed in applications 
09/074,034, 09/127,502, 09/185,380 and 09/287,940. The detection of the watermark can 
5 occur in various, and preferably numerous, locations in likely reproduction systems. In a 
desktop computer system, for example, image data may be analyzed for such a 
watermark by software in the scanner (e.g., scanner driver software), software in the 
computer (e.g., TWAIN interface software, operating system software, image editing 
software, internet browser software, printer driver software), and software in the printer 
1 0 (e.g., printer firmware). If any of these detectors encounters image data that has a "do not 
copy" watermark encoded therein, the detector will interfere with its reproduction (e.g., 
by discontinuing the process, by scarring the image, by hiding tracer data for later 
forensic use, etc.) 

The use of a watermark to indicate that an indicia should not be copied is 
1 5 desirable, but not necessary. Other hallmarks can be employed. For example, devices 
used in reproduction can be alert to the franking indicia itself and, if encountered, 
interfere with duplication. 

In accordance with a fourth aspect of the invention, security is enhanced by 
associating (cryptographically or otherwise) a digital watermark formed on envelope 
20 stock (e.g., by printing or texturing) with data conveyed in a postal franking mark (e.g., a 
2D bar code). In such case, for example, the envelope can be authorized for use only in 
conjunction with a certain printer, a certain postal meter, a certain postal account, a 
certain software, etc. If the envelope stock is diverted to another use (e.g., used in 
conjunction with a different postal meter), the discrepancy in the association between the 
25 envelope watermark and the postal franking mark can be detected by the postal 

authorities, and suitable action taken (e.g., alerting the proper owner of the envelope 
stock of such use). 

The association between the envelope watermark and the postal indicia can be 
self-contained (e.g., the association can be demonstrated without reference to external 
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resources), or a remote resource can be employed (e.g., a database can specify that 
envelope stock X should only be encountered with digital postage from account Y). 

In a variant embodiment, a franking station can check the watermark already 
existing on an envelope prior to applying postage. If a correct watermark is not detected, 
the franking station can decline to apply postage absent supervisory clearance. 
Unauthorized use of corporate mail accounts for use on personal correspondence may 
thereby be curbed. 

In accordance with a fifth aspect of the invention, watermarking on an envelope is 
employed as an element of a franking mark. Such marking can be confined to the corner 
location typically associated with postage, but need not be so limited. If the marking 
extends across the entire envelope - on one side or both - machine processing of the mail 
by the postal system can be facilitated by obviating the need for positioning the envelope 
in a certain orientation for reading. In one particular embodiment, an embedded 
calibration signal associated with certain watermarks (c.£, the cited patent documents) 
can be used to orient a digital image of the envelope for both watermark reading as well 
as for other machine processing. In other embodiments, printed features of a franking 
mark (e.g., vertical and horizontal lines) can be used like graticules to aid in establishing 
the skew of a watermark printed with the franking mark, thereby aiding decoding of the 
watermark. 

To make clear to office personnel that postage has been applied to such an 
envelope, it is generally desirable that the marking be visible. This can be achieved by 
increasing the amplitude of the watermark signal so that it appears as a patterned tile (or 
other shape). Or the watermark can be imperceptible, and other indicia added to indicate 
that postage has been applied (e.g., text stating "Posted with $0.33, printed in the same 
area as the watermark, or in a different area). 

In still other arrangements, a conventional 2D barcode franking mark is subtly 
changed to, itself, imperceptibly carry the watermark. 

The information encoded in the franking (or other) watermark can represent a 
great variety of data. The amount of postage encoded, the date of encoding, the sender's 
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name, address and zip code, the recipient's name, address and zip code, etc., can all be 
indicated. 

In some embodiments, all such information is directly encoded in the watermark. 
In other embodiments, the watermark encodes an abbreviated data set, e.g., including a 
5 code number. The code number corresponds to additional information that can be found 
in a database record accessed by the code - either maintained by the user, by a central 
authority (e.g., the postal system), or by some remotely accessible database. 

In accordance with a sixth aspect of the invention, watermarking on an envelope 
serves as a portal to a corresponding internet site or application (which could be local on 
10 the user's PC). 

As detailed in the assignee's application 09/571,422, filed May 15, 2000, a 
watermarked document can be held up to a web cam, or scanned by a scanner, and serve 
to instantly link a user to an Internet site, to invoke an application, etc. (The present 
assignee offers such services under the Digimarc MediaBridge name.) An envelope 
15 marked in this fashion can allow a user to initiate an essentially unlimited range of 
options. 

Consider an envelope having the sender's contact information (name, address, zip 
code, phone number, fax number, email address, etc.) represented by a watermark (either 
literally, or referring to a database record). A recipient of the envelope may present same 
20 to a web cam associated with a personal computer. The camera decodes the watermark, 
finds it is contact information for a person, and in response automatically adds the contact 
information to a contact organizer (e.g., Microsoft Outlook) maintained by the computer. 

Different watermarks may trigger different reactions. Certain of the payload bits 
in the watermark may indicate the type of data represented, and/or the type of reaction 
25 that is appropriate. Responses may be programmed by the sender, so the watermark is 
the same, but the backend system that is linked to the watermark contains the 
programming for what response to invoke. 

One type of watermark may indicate that the encoded information is contact 
information that is available for loading into a recipient's contact organizer. A second 
30 type of watermark may indicate that a delivery confirmation message is to be dispatched 
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to the sender of the envelope. When such an envelope is presented to the receipient's 
web cam, the associated computer automatically composes an email message confirming 
delivery of the envelope, and sends it to an address represented in the watermark. 
A third type of watermark may direct a web browser associated with the 

5 recipient's computer to a destination specified by the watermark. The destination web 
address can provide the recipient with additional information related to the mailing, but 
updated to the minute. Advertising mailings can thus link to ordering pages, new sale 
promotions, updated backorder status information, etc. Utility bills can link to summary 
account information showing payments received or owing, month-to-date charges, etc. 

1 0 The linked web address may present a form soliciting input or response from the 
envelope recipient, including survey responses, votes, etc. 

The linked resource needn't convey just textual or graphical information. 
Entertainment programming can be similarly invoked, e.g., the delivery of previews of 
tonight's cable television shows, popular music recordings for preview or purchase, etc. 

15 A fourth type of watermark may initiate a replenishment of postage in the 

recipient's digital postage account. 

The foregoing is just a small sampling of the myriad functions that can be invoked 
- locally in the recipient's computer, or employing remote resources (e.g., computers 
accessed over the internet) - in response to presentation of a mailing to a webcam or 

20 other imaging device. 

Some watermarks may correspond to several alternative actions. In such case, the 
recipient's computer may present a menu from which the recipient can select the desired 
response. Or the response invoked by presenting the envelope to the web cam may be 
made dependent on context or environment in which the presentation is made (e.g., time 

25 of day, type of device to which web cam is connected - fixed or portable computer, wired 
or wireless, etc.) 

In a variant of the foregoing embodiment, an envelope watermark serves to 
convey an identifier that is used to access a database record having information related to 
mail processing or delivery. In one particular application, the index number identifies the 
30 recipient. Thus, for example, an envelope can be addressed simply by watermarking it 
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with a unique recipient designator, e.g., JOHNQPUBLIC843. Processing equipment in 
the postal system can read the watermark, query a database with the designator, and 
determine thereby the recipient's physical address (e.g., street address). 

In some such embodiments, the physical address information obtained by this 
database lookup is printed on the envelope by the postal system for the benefit of the 
ultimate postal delivery person. In other embodiments, the postal delivery person is 
equipped with reader devices that make such printing superfluous. 

As noted, an important advantage to this arrangement is that Change of Address 
cards would be a thing of the past. If a person moves across country, a single record in 
the database is changed. All mail to that recipient automatically is directed to the new 
physical address. A lifetime postal addressing system can thereby be realized. 

In accordance with yet another embodiment, digital watermarks on envelopes can 
be applied by postal metering devices, or by using common office printers (e.g., laser, 
ink-jet). In such systems, the watermark embedding functionality may be integrated into 
the printing device (e.g., by firmware executed by a printer microprocessor, or by 
dedicated hardware), or can be resident as software on an associated computer system. 
The software is desirably secured against tampering using various anti-hacking 
techniques. The production of the digital watermark may not be optional (i.e., it may be 
applied without user control), and the payload can be tailored in accordance with the 
amount of postage, device/so ftware/user information, or other application information. 

Such a system may also include an application that calibrates printing of the 
watermark to the user's specific printer or software. For example, the application (which 
may be a software program) may print a predetermined pattern (watermark or otherwise). 
The resulting printed media can then be scanned using a scanner (e.g., a digital 
photocopier or other device) whose transfer function is known. (The application may 
have profile data on several common scanning devices that can be selectively invoked 
(e.g., by the user), depending on the particular scanner used.) The scanned image data is 
then processed by the application to infer the characteristics of the user's printer or 
software (e.g., its transfer function). Once these characteristics are known, the 
watermarking process can pre-compensate for such printer/software characteristics so as 
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to produce a watermark whose attributes are largely independent of the printer/software 
from which it was generated. (E.g., if a printer exhibits attenuated reproduction of high 
frequency image data, the high frequency components can be pre-emphasized prior to 
sending the watermark data to the printer. Similarly, if the dot pitch produced by the 
5 printer emphasizes particular spatial frequencies, the watermark image data can be pre- 
compensated to de-emphasize such spatial frequencies.) 

In other embodiments, the transfer functions of printing systems commonly used 
by users can be pre-characterized by the manufacturer, and appropriate compensation of 
watermark printing can be based thereon. Thus, for example, if a user is printing postage 
10 using a Hewlett-Packard LaserJet 8000DN printer, a first set of pre-stored pre- 

compensation information is utilized. If the user is printing using a Hewlett-Packard 
^ DeskJet 860C, a second set of pre-compensation information is utilized, etc. (The 

IP specification of the particular printer being used can be left to the user, or it can be 

S determined by reference to data available in the computer system (e.g., by reference to 

1^ 15 the printer driver file being employed.)) 

m 

syn The net result, again, is to make the printed end-product substantially uniform 

L regardless of the idiosyncrasies of particular printing systems. (Further information on 

CJ characterizing the transfer function of devices to assure reliable watermark 

jUL communication is found in copending application 60/173,880, filed December 30, 1999.) 

20 In some embodiments, a hardware security device that is used, e.g., to store 

postage value (e.g., a digital vault) may also be employed by the watermark embedding 
system, e.g., as a source of secure and potentially unique data used in encoding the digital 
watermark (e.g., crypto keys, pseudo-random noise data, etc.). In some such 
arrangements, the watermark embedding system may make use of data stored in such 
25 device primarily for another purpose (e.g., a user ID), and can employ such data in 
conjunction with the watermarking operation (e.g., as a seed to a random number 
generator that produces a noise pattern utilized in the watermark encoding). 

In accordance with still further embodiments of the invention, the principles 
described herein are also applicable to other printed value documents (e.g., tickets and 
30 coupons), especially those that are printed on demand. Such documents may be printed 



WYC:lmp 10/11/00 60307 



-14- EXPRESS MAIL NO. EL696454188US 



at home, at special kiosks (e.g., in-store), or by commercial printing establishments (i.e., 
mass produced). Among other functionality, the watermarks in such value documents 
can be used by investigators to distinguish originals from reproductions (by use of fragile 
watermarks), to authenticate documents (e.g., in ticket reading machines), and to link to 
associated internet resources. (An example of the latter is a ticket to a sporting or 
theatrical event that, when presented to a web cam, allows the user to see an actual or 
virtual view of the sports arena/stage from the perspective of the ticketed seat.) 

The watermarks on printed value documents can also be linked to other 
information (e.g., event date, seat number, product code, etc.) that is textually printed on 
the document, or present on the document in some machine readable form (e.g., 
barcodes). In such case, the watermark can be used to detect document alteration by 
checking for discrepancy between the watermark-encoded information, and that 
otherwise conveyed by the document. 

In accordance with still other embodiments, blank paper stock can be digitally 
watermarked so that printed documents formed by later printing on the stock exhibits 
desired functionality. (The watermark in the blank stock persists through, and is 
detectable notwithstanding, subsequent printing.) 

For example, blank paper stock can be digitally watermarked with a frail 
watermark that permits the original document to be distinguished from photocopies or 
other reproductions. Or blank stock used as corporate stationary can be watermarked 
with data serving as an internet link to the corporation's web site. Or serialized sheets 
can be employed by a corporation for sensitive memoranda, allowing a printed document 
to be distinguished from seemingly-identical documents, e.g., permitting the document to 
be traced back to its original intended recipient 

As in the examples earlier given, the watermark can be formed by ink (e.g., 
speckles, or tinting) or by texture. The watermark can be formed on the paper in bulk - in 
the paper-making process, or can be applied on a per-sheet basis. In the former case, the 
same watermark payload is encoded on large lots of paper, whereas in the second case, 
different watermark payloads can be applied to different sheets (e.g., serialized paper). 
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(The later process can be performed by high-speed printing machines specialized for this 
purpose, e.g., employing page-width ink-jet arrays.) 

(Watermarking of blank paper stock is referenced in various of the assignee's 
applications, including 09/127,502 and 09,619,264, as well as in patent 5,822,436.) 

It will be recognized that the arrangements described above can be combined and 
hybridized in various ways to economically effect multiple functionality. 

To provide a comprehensive disclosure without unduly lengthening this 
specification, the patents and applications cited herein are incorporated herein by 
reference. 

Having described and illustrated the principles of the invention with reference to 
illustrative embodiments, it should be recognized that the invention is not so limited. 

For example, while digital watermarking typically does not leave any human- 
apparent evidence of alteration or data representation, certain of the foregoing 
applications do not require this. The markings used may be visible, and even 
conspicuous, without impairing essential functionality. Thus, bar codes, data glyphs, 
OCR markings, and other machine-readable indicia may be substituted, depending on the 
particular application requirements. 

While the detailed embodiments were described with reference to desktop 
computers, it is recognized that such devices will increasingly be supplanted by other 
digital appliances, including general purpose personal digital assistants, multifunction 
cell phones, and specialized devices - many of which include integrated optical sensors 
(e.g., CCD or CMOS cameras). Moreover, the power and utility of the above-detailed 
embodiments and devices can be further enhanced by employing various wireless 
communications technologies, including the Bluetooth standard. 

The implementation of the watermark encoding and decoding systems is 
straightforward to artisans in the field, and thus not belabored here. Conventionally, such 
technology is implemented by suitable software, stored in long term memory (e.g., disk, 
ROM, etc.), and transferred to temporary memory (e.g., RAM) for execution on an 
associated CPU. In other implementations, the functionality can be achieved by 
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dedicated hardware, or by a combination of hardware and software. Reprogrammable 
logic, including FPGAs, can advantageously be employed in certain implementations. 

While the specification makes reference to "paper" and "envelopes," these terms 
are used in shorthand fashion to refer to articles delivered by the postal service. Thus, 
5 postcards (e.g., direct mail cards) and Tyvek articles are meant to be encompassed by 
such references. Postcards may include multiple watermarks, e.g., a postal-related mark 
on the "address side," and an internet-linking mark on the other. The two marks may be 
associated or linked in various manners. 

Although not described in the context of existing postal meters, it should be 
1 0 recognized that the above-detailed technology is well-suited for implementation with 
such devices, as they generally use printing techniques that are suitable for digital 
% watermark printing. By retrofitting existing postal meters, a great variety of security and 

0 1 marketing improvements can readily be provided. 

S The reader will recognize that a variety of additional security techniques can be 

JS[ 15 employed in conjunction with the arrangements detailed above. For example, in some 
B applications, it is useful to encrypt the message encoded in the watermark. Encryption 

L provides an additional layer of security to prevent unwanted uses of the encoded 

|p information. Some examples of applicable cryptographic methods include RSA, DES, 

U IDEA (International Data Encryption Algorithm), skipjack, discrete log systems (e.g., El 

5j 20 Gamal Cipher), elliptic curve systems, cellular automata, etc. 

These and other cryptographic methods can be used to create a digital signature to 
place in a watermark message. Public key cryptographic methods employ a private and 
public key. The private key is kept secret, and the public key is distributed. To digitally 
sign a message, the originator of the message encrypts the message with his private key. 
25 The private key is uniquely associated with the originator. Those users having a public 
key verify that the message has originated from the holder of the private key by using the 
public key to decrypt the message. 

The message may be both encrypted and digitally signed using two stages of 
encryption. At the encoder, a digital signature stage encrypts at least part of the message 
30 with a private key. An encryption stage then encrypts the message with a public key. 



WYC:imp io/n/00 60307 -17- EXPRESS MAIL NO. EL696454 18 8US 

The decoder reverses the process. First, a decryption stage decrypts the message with a 

private key corresponding to public key used in the encryption stage at the encoder. 

Then, a second stage decrypts the output of the previous stage with the public key 

corresponding to the private key used to create the digital signature. 
5 Time and date stamping can be used in conjunction with encryption, or otherwise 

(e.g., in a watermark). Metadata can similarly be conveyed. 

If desired, a watermark can be used to track mail (e.g., an envelope or parcel) 

through the delivery process. At various check points, a camera- or sensor-equipped 

device reads the watermark, extracts an identifier and logs the identifier along with 
10 additional information, such as location, time, etc. This information may be sent and 

maintained in a database that can be queried to determine the delivery status of the mail. 

Wireless devices can be employed to read watermarks and report status to a centralized or 

distributed database. 

It should be recognized that the particular combinations of elements and features 
15 in the above-detailed embodiments are exemplary only; the interchanging and 

substitution of these teachings with other teachings in this and the incorporated-by- 

reference patent s/applications are also contemplated. 

In view of the wide variety of embodiments to which the principles and features 

discussed above can be applied, it should be apparent that the detailed embodiments are 
20 illustrative only and should not be taken as limiting the scope of the invention. Rather, 

we claim as our invention all such modifications as may come within the scope and spirit 

of the following claims and equivalents thereof. 
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WE CLAIM: 

1. An original envelope having encoded thereon a fragile digital watermark 
representing plural bits of digital data, said watermark permitting a photocopy thereof to 

5 be distinguished from the original. 

2. The envelope of claim 1 in which the watermark is formed with ink. 

3. The envelope of claim 1 in which the watermark is formed by texturing of the 
1 0 original envelope medium 

4. The envelope of claim 1 that additionally has encoded thereon a second digital 
watermark that withstands at least certain photocopying operations. 

15 5 . The envelope of claim 4 in which the second digital watermark encodes data 

useful for linking to an internet computer site. 

6. The envelope of claim 4 in which the second digital watermark encodes data 
representing a device or user that produced the document. 

20 

7. The envelope of claim 4 in which one of said watermarks indicates to 
compliant equipment that the envelope should not be reproduced. 

8. The envelope of claim 4 in which the second digital watermark is printed on 
25 the envelope at the same time as a franking mark. 

9. The envelope of claim 8 in which the second digital watermark is printed on 
the envelope by the same printing assembly used to print said franking mark. 
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10. The envelope of claim 4 in which at least one of said digital watermarks 
occupies a region that is also occupied by a franking mark printed on said envelope. 

1 1 . The envelope of claim 4 in which the second watermark is formed on a 
second side of the envelope, opposite a side on which the first watermark is formed. 

12. The envelope of claim 1 in which said digital watermark is printed on the 
envelope at the same time as a franking mark. 

13. The envelope of claim 1 in which said digital watermark is printed on the 
envelope by the same printing assembly used to print said franking mark. 

14. A blank original substrate suitable for later use in a printing operation to 
produce a printed document, the blank original substrate having encoded thereon a fragile 
digital watermark representing plural bits of digital data, said watermark permitting a 
photocopy thereof to be distinguished from the original. 

15. The substrate of claim 14 in which the watermark is formed with ink. 

16. The substrate of claim 14 in which the watermark is formed by texturing of 
the substrate medium 

17. A printed document comprising the substrate of claim 14 that additionally has 
encoded thereon a second digital watermark that withstands at least certain photocopying 
operations. 

18. The document of claim 17 in which the second digital watermark encodes 
data useful for linking to an internet computer site. 
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19. The document of claim 17 in which the second digital watermark encodes 
data representing a device or user that produced the document. 

20. The document of claim 17 in which the second watermark is formed on a 
second side of the envelope, opposite a side on which the first watermark is formed. 

21. The substrate of claim 14 in which the watermark indicates to compliant 
equipment that the envelope should not be reproduced. 
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PRINTING MEDIA AND METHODS EMPLOYING DIGITAL WATERMARKS 



Abstract of the Disclosure 
Digital watermarks are encoded on envelopes to serve a variety of purposes 
related to postage (franking), anti-counterfeiting, addressing, and linking to associated 
internet sites. Digital watermarks can also be formed on blank paper stock so that printed 
documents formed therewith have desired properties, including the ability to distinguish 
photocopies from originals, to link to corporate web sites, and to permit document 
serialization for tracing and other purposes. 
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COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 
I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and 
joint inventor (if plural names are listed below) of the subject matter which is claimed and for which a 
patent is sought on the invention entitled PRINTING MEDIA AND METHODS EMPLOYING DIGITAL 
WATERMARKS, the specification of which 

[x] is attached hereto. 

[ ] was filed on as Application No. . 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to patentability as defined in Title 
37, Code of Federal Regulations, § 1 .56. If this is a continuation-in-part application filed under the 
conditions specified in 35 U.S.C. § 120 which discloses and claims subject matter in addition to that 
disclosed in the prior copending application, I further acknowledge the duty to disclose material 
information as defined in 37 CFR § 1 .56 which occurred between the filing date of the prior application and 
the national or PCT international filing date of the continuation-in-part application. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19(a)-(d) of any 
foreign application(s) for patent or inventor's certificate or of any PCT International application(s) 
designating at least one country other than the United States of America listed below and have 
also identified below any foreign application(s) for patent or inventor's certificate or any PCT International 
application (s) designating at least one country other than the United States of America filed by me on the 
same subject matter having a filing date before that of the application(s) on which priority is claimed: 

Prior Foreign Application(s) Priority 

Claimed 

[] [] 

(Number) (Country) (Day/Month/Year Filed) Yes No 

I hereby claim the benefit under Title 35, United States Code, § 1 19(e) of any United States 
provisional application(s) listed below: 



Application Number Filing Date 

I hereby claim the benefit under Title 35, United States Code, § 120 of any United States 
application(s) or § 365(c) of any PCT International application(s) designating the United States, listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the 
prior United States or PCT International application in the manner provided by the first paragraph of Title 
35, United States Code, § 1 12, 1 acknowledge the duty to disclose material information as defined in Title 
37, Code of Federal Regulations, § 1.56(a) which occurred between the filing date of the prior application 
and the national or PCT International filing date of this application: 

09/567,405 5/8/00 Pending 

(Application No.) (Filing Date) (Status: patented, 

Pending, abandoned) 
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The undersigned hereby authorizes the U.S. attorney or agent named herein to accept and follow 

instructions from as to any action to be taken in the Patent and Trademark Office regarding 

this application without direct communication between the U.S. attorney or agent and the undersigned. In 
the event of a change in the persons from whom instructions may be taken, the U.S. attorney or agent 
named herein will be so notified by the undersigned. 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application, to file a 
corresponding international application, and to transact all business in the Patent and Trademark Office 
connected therewith: 



William Y. Conwell 
Joel R. Meyer 
Thomas M. Horgan 
Elmer Galbi 



Reg. No. 31,943 
Reg. No. 37,677 
Reg. No. 33,183 
Reg. No. 19,761 



Address all telephone calls to William Y. Conwell at telephone number (503) 885-9699. 
Address all correspondence to: 



William Y. Conwell 

DIGIMARC Corporation 

Digimarc Corporation 

19801 SW 72nd Avenue, Suite 250 

Tualatin, OR 97062 



I hereby declare that all statements made herein of my own knowledge are true and that all 
statements made on information and belief are believed to be true; and further that these statements were 
made with the knowledge that willful false statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 



Full Name of Sole or first Inventor: J. Scott Carr 



Inventor's Signature 

Date 

Residence: Beaverton, Oregon 
Citizenship: USA 

Post Office Address: 7814 SW 1 89 th Avenue, Beaverton, OR 97007 



Full Name of Second Joint Inventor: Geoffrey B. Rhoads 
Inventor's Signature 

Date 

Residence: West Linn, Oregon 
Citizenship: USA 

Post Office Address: 2961 SW Turner Road, West Linn, Oregon 97068 
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